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ABSTRACT 

A study of discourse synthesis (readers/writers 
composing new texts by selecting, organizing, and connecting content 
from source texts) examined the performance of accomplished and less 
accomplished readers in the 6th, dth, and 10th grades on a 
report-writing task. Over a 3-day period 60 English/language arts 
students wrote informational reports composed of content they 
selected from 3 source texts (encyclopedia articles on a single 
topic) as well as content they added. Text analyses revealed patterns 
associated with both grade level and reading ability in selecting and 
connecting content, since the older students and the accomplished 
readers included larger proportions of intertextually important 
content from the source texts and provided more connectivity for 
their readers. Analyses also revealed patterns associated with 
reading ability in the nature of the text structures that students 
used to organize clusters of content. Moreover, differences between 
readers were manifested on measures of tas)c management as well as on 
text features, with tie accomplished readers developing more 
elaborate written plans and spending more time on the task. The study 
extended research into writing as well as research into reading by 
focusing on a hybrid, reading-to-write task that involves both 
constructive processes. (Five tables of data and 6 figures are 
included, and 81 references are attached.) (Author/SR) 
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Abstract 



In discourse synthesis readers/writers compose new texts by selecting, organizing, 
and connecting content from source texts. This study cf discourse synthesis 
examined the perforaiance of accomplished and less acconq)lished readers in the 6th, 
8th, and 10th grades cm a repoit-writmg task. Over a three-day period in their 
English/language arts classes, the 60 students in the study wrote informational reports 
coasposcd of ccmtent they selected from thxte source texts (encyclopedia articles on a 
single topic) as well as content they added Text analyses revealed patterns associated 
wi& both grade level and reading ability in selecting and connecting content, since the 
older students and the accomplished readers included larger proportions of 
intertextually inqxsrtant content from die source texts and provided more connectivity 
for their readers. Analyses also revealed patterns associated with reading ability in 
the nature of the text structures that students used to organize clusters of a utent 
Moreover, differences between readers were manifested on measures of task 
management as wtU as on text features, with the acccnnplished reader developing 
more elaborate written plans and spenc&ig more time on die task. The study extends 
research into writing as well as research into reading by focusing on a hybrid, 
reading-to-write task that involves both constractive processes. 



READERS AS WRITERS COMPOSING FROM SOURCES 



By 

Nancy Nelson Spivey 
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and 
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For the past IS ytm or so, reading researchers in the constructivist tradition 
have been studying discourse comprehension as readers' buildiig of mental 
representations duough their interacticxis with texts. Constructivism portrays readers 
as making meaning fay integrating content from source texts with previously acquired 
knowledge in a process that involves the q)erations of selecting, organizing, and 
connecting. Readers select content on the basis of scxne relevance principle, organize 
the content by applying their knowledge of discourse structures, and connect related 
ideas by discovering and generating links (for a review of research in the 
constructivist traditi(Hi, sec Spivey, 1987). Selecting, organizing, and connecting are 
also {^parent in discourse synthesis, a highly constructive act in which readers 
beconae writers (Spivey, 1984). In discourse synthesis readns/writers select, 
organize, and connect content from source texts as they compose their own new 
texts. On vfhat basis do they make these selections for their syntheses? How do they 
organize tfie content they select? How successful are they at transforming the source 
contmt into dieir own connected discourse? These questicms guided the study 
repented here which looked for patterns associated with age/grade level and general 
reading ability, two factors examined rather extensively in comprehension research. 
The study was thus informed by constructivist perspectives on reading to understand 
as well as by recent inquiries into reading to write (Flower, 1987). 

Reading to Understand a Text 

Because readers cannot, or may not want to, retain all of the information fiom a 
text, they select from Hoc available content Reading is almost jdways an abstractive, 
reductive process in which a subset of the source material is integrated. 
Readers, either tacitiy or consciously depending on the task demands, make 
selections on the basis of some relevance principle, some criterion of importance. 
This criterion, according to van Dijk (1979), may be textual, how high die content is 
placed in tfje text structure (cf. Meyer, 1975), or contextual, how salient tiie content is 
to tiie reading task (cf. Hayes, Waterman, & Robinson, 1977; Kchert & Anderson, 
1977). It may also result from some specific interest of die reader (e.g., Anderson, 
Reynolds, Schallert, & Goetz, 1977). Current research, which has emphasized the 
role of textual inqx}rtance, has demonstrated a strong levels effect, with people 
remembering informatim that is prominendy placed textually (Johnson, 1970; 
McKoon, 1977; Meyer, 1975). Even when tiiey do not understand tfie content and 
their reading is characterized by "shallow semantics," mature readers are often able to 
select die textually important content (Kieras, 1982, 1985). 

Readers organize, as well as select, content as they construct representations of 
texts. They apparently use a macroprocessing strategy based on knowledge and use 
of organizational patterns of discourse (Kintsch & Yarbrough, 1982); diey approach 
texts knowing how discourse is conventionally organized and how to use text 
structures to guide dieir understandings. When Uiey have no overriding purpose or 
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perspective and the texts they itad aie well organized, skilled readers in itseaich 
studies usually use the same organizaticMi as that of the text They do so in reading 
stories (e.g., Thomdyke, 1977) and expository texts as well (e.g., Meyer, 1975). 
Meyer and her colleagues (Meyer, Brandt, & Bluth, 1980) attribute this finding to the 
reader's ability to use the structure strategy, xr **follow the text's superordinate 
relational structure" and to "search for relationships which can subsume all or large 
chunks of this information and turn it into a summarized comprehensible whole" (p. 
78). If, however, the texts are disorganized, or even scrambled, then skilled readers 
also demonstrate the ability to supply structure, to make the texts conform to a 
conventional pattem (e.g.. Stein & Nezworksi, 1978; Thomdyke, 1977). There is 
also evidence that people intentionally restructure a ttxi when they disagree with the 
message (Meyer & Freedle, 1984). 

Although the overall organize ion helps to supply global coherence to a text and 
to its mental representation, the rep^r must connect ccHitent at local levels as well 
(i.e., at the level of propositions, clauses, and sentences) in the discourse structure, 
llie text provides some guidance for linking ideas through various kinds of cues, 
such as logical connectives (Frederiksen, 1975), linguistic cohesion, including 
anaphoric ties (Halliday & Hasan, 1976), topic-comment patterns (Danes, 1974), and 
given-new placement of information (Caik & Haviland, 1977). Although readers 
use the locsd-level connections supplied in the source, they also generate connections 
of their own in the form of inferences OCSark, 1977), which become an integral part 
of the mental representation of the text (Kintsch, 1974). Whereas various types of 
inferences have been identified (e.g. S^iiert, Robertson, & Black, 1985), some types 
seem more ixoportznt than others in the reading of certain texts, such as causal 
inferences in die reading of stories (Kemper 1982). Since reading is a constructive 
process and readers mate these inferences, the text does not have to be completely 
explicit in regard to ccxinectivity. 

The research thus shows that readers make good use of what the text offers. 
Yet, even with the same text, people vary in the constructions they make. This 
variability is quite apparent when researchers compare readers' recalls or summaries, 
forms of second-order discourse (Kintsch & van Dijk, 1978), with the sources. A 
number of factors within the reader can affect the nature of the constructions, such as 
prior knowledge of die topic (e.g., Chiesi, Spilich, & Voss, 1979). People with 
extensive topic kiK)wledge know what is important to select; they instantiate 
appropriate organizational patterns for the content and can use tiieir topic knowledge 
to make connective inferences to fill in gaps. Twoothr fiactors that have accounted 
for important differences among readers in previous research are developmental level, 
often indexed by grade in school or by age, and verbal ability, most often assessed 
with a test of reading achievement Of course, age/gtade level and reading ability are 
not completely distinct fix>m each other. As people mature and progress through 
school, their reading abilities increase even when their relative positions among their 
peers, in terms of stanine and percentile scores from reading tests, appear stable. 

Developmental patterns in readers' selections emerge in studies of recalling and 
summarizing. With maturity people develop an awareness of textual importance, and 
they use that knowledge in making selections. Although McGee's (1982) study of 
text recall suggests strong developmental contrasts in students' selections between 
3rd and 5th grades, research in summarizing by Brown and her colleagues indicate 
that the years after 7th grade are especially critical for the metacognitive development 
that is associated with sensitivity to texnial importance. At about that time they begin 
to use their study time to leam the most important content in a text (Brown & Smiley, 
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1978). And between 7th gnide and 10th grade they begin to gain real proficiency in 
summarizing, moving beymd the single strategy of deleting trivial and rxlundant 
content to use of the more sophisticated summary rules, which include selection of 
tq)ic sentences (Brown & Day, 1983). Research has rlso demonstrated patterns in 
selecting that are associated widi reading ability; better readers at various levels of 
schooling are more adept than less able readers at selecting textually important content 
for their recalls and summanes (Eamon, 1978; Johns, 1985; McGee, 1982; Meyer, 
Brandt, &Bluth, 1980; Winograd, 1984). 

Like sensitivity tr. textual importance, use of text organization appears to be 
associated with age/grade level and reading ability. In contrast to young readers, 
more mature readers are more likely to use the same organization as that of a well 
structured source text for their recalls (McGee, 1982); in addition, they are better at 
in^osing organization on a disorganized source text (Stein & Nezworski, 1978). 
Developmental studies also suggest tiiat okler students demonstrate better recognition 
of text structures (Englert & Hiebert, 1^34) and may produce better organized reports 
of tiieir own (Langer, 1985, 1986). In comparisons based on reading ability, skilled 
readers make more use of the organizaticm of the source text in recalling discourse 
than do less skilled readers (McGee, 1982; Meyer, Brandt, & Bluth, 1980; Taylor, 
1980). Moreover, they are better at producing and recognizing various structures 
(Hiebert, Englert, & Brennan, 1983). 

Finally, the ability to supply connective links in comprehending discourse has 
also been as50ciated with both maturity/grade level (e.g., Schmidt & Paris, 1983) and 
achievement in reading( e.g.. Holmes, 1987). Though developnKntal research has 
not focused directiy on the connectedness of second-order (Uscourse, a growing 
number of studies shows that, as students mature, their "original" discourse becomes 
more connected (McCutchen, 1986; McChitciien &Perfetti, 1982; Scinto, 1986). In 
recalling discourse, better ir^iders supply more connections, tending to produce true 
connected discourse, while less skilled readers' recalls are more like disconnected 
lists (Marshall & Clock, 1978-79; Meyer, Brandt, & Blutii, 1980). 

Reading to Write 

In addition to factors witiun the reader, such as maturity and reading ability, the 
nature of tfic reading task can also affect readers' constrjctions. Much of our 
research thus hr has emphasiTxd reading to comprehend (to imderstand, to learn, to 
remember); the reader's major task in these studies is to acquire knowledge. After 
reading, the reader may write a recall or a summary, but that pixxiuction is mainly to 
demonstrate or to check the knowledge that has been acquired. Of course, in tiie real 
world people have otiier purposes for reading that differ from, or go beyond, 
knowledge acquisition, and tiiey can vary their reading accra^g to their purposes. 
A number of studies (e.g., McConkie, Rayncr, & Wilson, 1973; Postman & 
Senders, 1946) dranonstrate tiiat people adapi: their reading to meet the requirements 
of different tasks. A relatively new development, though, is the study of tasks that 
entail reading to write (Flower, 1987), tasks in which readers use textual sources to 
produce their own new texts that have a communicative intent tostead of being either 
reading tasks or writing tasks, these tasks are hybrids, as Bracewell, Frederiksen, 
andFrederiksen (1982) explain: 

TTie task environment . . . reveals how discourse production and 
discourse comprehension are related. They are not opposites, but rather 
are processes that may both occur in a task environment The extent to 
which a task is regarded as a production or comprehension task depends 



cm the specific constraints that aie operating and a£fecting the 
con^nehension and production processes of the language user. Thus 
discourse tasks constitute a family — Between the extremes of the 
dimensions, where information constraints are at an intermediate level* 
liesarangeof tasks which we label as hybrid tasks. These tasks have 
characteristics of both discourse production and discourse 
comprehension, (p. 55) 

The products of these hybrid tasks can be studied in much the same way as the 
products of reading comprehension (recalls, sunmiaries) to see how people construct 
meaning. However, since reading to write encompasses acts of composing, attention 
can also be directed to how people manage the rhetorical task of communicating. 

Some hybrid reading-to-write tasks involve discourse synthesis, a process in 
which readers/writers read multiple texts on a topic and synthesize them to cieate new 
texts (Spivey, 1984). They selea content from the composite offered by the 
sources-content that varies in its intertextual importance because some may be 
available only in one source and some may be repeated across text>. They organize 
the content, often hp^'iiig to supply a new organizational structure. And they connect 
it by providing link, among xthtod ideas that may have been drawn from multiple 
sources. Synthesis is an act of comprehending, in which the reader forms a mental 
representation from textual cues. Moreover, it is an act of composing that msults in a 
new text to be read (or heard), a text that is shaped by rhetorical considerations, such 
as purpose and audience (Kinneavy, 1971), and that is the product composing 
strategies, including planning and revising (Rower & Hayes, 198 1 ; Hayes & 
Hower, 1980). 

How do people of varying ages and reading abilities select, organize, and 
connect c(Hitent from sources when they perfomi a constructive act of discourse 
synthesis? The reading research reviewed earlier suggests sonie developmental 
patterns and reading-ability patterns when people read texts for purposes of 
cooqnehension. Arc there similar developmental and reading ability patterns in those 
operations when the task involves reading to write? Though we have no 
develq)mental research in discourse sy^itihesis, some studies have begun to look at 
how students of differLnt reading abilities perfomL Spivey (1984) gave 
UiUversiQr-level juniors and seniors a task that entailed writing an informational text 
for yoiing adults that incocporated material drawn from three descriptive texts on a 
single topic. The student's syntheses, like the source texts, had fi^elike collection 
stractures with clusters of content on subtopics. Proficient readers performed 
differentiy from less proficient readers oa the task, la selecting content for the 
syntheses, they not only included nx>re source material but also demonstrated more 
sensitivity \o importance-an intertextual importance determined by the height of a 
given idea in the hierarchy of a single text and by its repetitions across texts. They 
organized their compositions differentiy, providing more compact, integrated 
collection structures for their texts, though they included more content Their 
products, which received higher holistic quality ratings, were also better connected, 
requiring fewer resource-consuming operations and isitcrences on die oart of readers. 
A second study (Spivey, 1988) that had college smdents syntfie??ize informational 
discourse with a comparison structure for their peers also linked reading ability with 
characteristics of syntheses, especially oiganization. 

Are differences among readers reflected in how the students approach and 
manage the synti>esizing task? Do better readers zxptrA more effort in synthesizing 
the material to arrive at tiieir better syntheses? Do they expend less effort? Spivey 



(1984) included three surface measures for aspects of task management-plan, 
revision, and reading-writing tiiae-but found no differences between the two groups 
on any of the three, perhaps because of the nature of the measures. The measure for 
planning might have given undue attention to a mechanical aspect of the process, 
underiining on the source texts, since the scale gave as much weight to maiidng the 
sources as to developing a written plan. The measure for revision might not have 
focused on critical aspects of textual change, since it included all kinds of 
retranscriptions. As m other studies (e.g., Faigley & Witte, 1981; Sommers, 1980), 
many of die students' retranscriptions, which were at the word bvel, did not result in 
sitbstantive changes in the text In another study involving multiple sources, 
Kennedy (1985) did find differences between skilled and less skilled college readers 
in managing the task of writing an "objective essay." Kennedy focused her research 
on behaviors, as reflected in dtink-aloud protocols, of students who were given 
Quiltiple source texts and were asked to write the essay. Despite the small sample size 
(six subjects), she found some evidence in the protocols that the fluent readers were 
more actively engaged widi the sources. From the study, though, we do not know it 
die students developed different kinds of written plans or made different kinds of 
retransc prions, since the products were not analyzed nor do we know if either 
group ,icnt more time, since the data were reported in terms of episode frequency 
and not total time. 



One would expect to find differences among groups of readers to be reflected in 
how they manage die task as well as in die kinds of texts produced. To date, though, 
diere is litde evidence of how differences associated widi reading abilitry might be 
manifested in written plans, textual changes, or time devoted to a synthesis task. Nor 
do we have a strong basis for predicting developmental differences on die tiuce. 
Altfiough studies in odier types of composing indicate links between adult expertise 
and planning (e.g., Hower & Hayes, 1981) as weU as between adult expertise and 
large-scale textual changes (e.g., Faigley & Witte, 19«1), research in writing tfius far 
indicates tiiat for much of tfieir writing many students, even high school seniors and 
college stodcnts, do litde whole-text planning and litde revising diat is substantive 
(e.g., Buder-Nalin, 1984; Emig, 1971; NAEP, 1977; Pianko, 1979; Sommers, 



Thou^ the three earlier synthesis studies tell us somediing about how 
readers/writers syndiesize from multiple sources, this research has been limited to die 
performance of college students. The study reported here extended research in 
discoipe syndiysis by investigating die performance of younger students. Our 
objective was to continue die line of research uito variability among readers by 
examining in a single study diffeiences associated bodi widi grade level and widi 
reading-ability classification at diat grade level: (1) to see how developmental 
differences might manifest diemselves across diree grade levels during an important 
five-year peiiod in students' schooling and (2) to see how students of different 
reading abilities at diose grade levels make use of sources to write their own 
informational texts. The study, based on die constractivist framework described 
above, focused on textoal evidences of selecting, organizing, and connecting, as well 
as die overall quality of die text It also incorporated on a heuristic basis diree surface 
measures for aspects of task management: plan, retranscription, and reading-wiiting 
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Method 



Subjects 

Participants in the study were 60 students in the 6th, 8th, and 10th grades in a 
public school district in northern Texas. Of the 20 students firmn each grade level, 10 
were accomplished readers for tfieir grade level and 10 were less accomplished 
readers, as indicated by dieir scores on the Reading Comprehension Subtest of the 
Comprehensive Test of Ba.;ic Skills (CTB/McGraw-Hill, 1983). The accomplished 
group's scores were in the upper three stanines (7th, 8th, 9th), and the less 
acconq)lished group's scores were in tlie middle stanines (4th, Sth, 6th). Group 
designations were confirmed with students* pertbrmance on cloze passages. The 
subjects came from six English/language arts classes (cwo at each grade level) that 
participated in the study. We limited the subjects to students who were present all 
three days of the study and who con^)leted the assif jiment, and so we excluded 6 
students (2 from grade 6, 1 from grade 8, and 3 from grade 10) who were abs<tnt <mc 
day or more during the study and one 8th-grade srjdent who did not complete her 
report We also screened for topic knowledge. Students from participating classes 
were tested for prior tq)ic knowledge with a method siouiar to Langei 's (1984) 
free-association measure, though we modified die procedure by using a sing'e cue, 
rodeo, instead of three. People with extremes of minimal topic knowledge (2 
students) or extensive, highly organized knowledge (3 students) were not included 
We used a random selection process to select the 60 subjects from pools stratified by 
gender as well as reading ability and grade level so that the groups would be balanced 
in numbers of males and females. 

Materials 

The source texts ot the topk: "rcxlco" were three descriptive texts reelected from 
reference sources intended for use in the middle school years: Britannica Junior 
Encyclopaedia (Encyclq)aedia Britannica, 1981), World Book Encyclopedia (World 
Book, 1986), mdThe New Book of Knowledge (Gmlxtr, 1985). Wonicount was 
453, 931, and 1226, respectively. All three informational texts were organized with a 
collection top-level structure (tfUyer, 1985) that had inforatiation clusters on such 
themes as rodeo events, rodeo sponsors, and participants' skills. As shown in Table 
1, within the three textual sources was a composite of content with some repetition 
across texts. Although some units of the content appeared iq only one text, others 
appeared in two, and some in all three. For instance, all three texts tell th.^ reader that 
th^ is a Rodeo Cowboys Association, two say that the association makes rules for 
rodeo events, and cme mentions that stock contractors are members of the association. 
Following Spivey (1984), content units of informative facts were derived from a 
parsing procedure based on Turner and Greene's ( 1978) formalization of Kintsch's 
(1974) propositional analysis. 
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Brit. Jr. 



Woild Book New Bool of 



Content units in this text 
oniy 



71 



105 



124 



Content units in this text 
and one another 



26 



59 



52 



Oxitent units in this text 
and both of the others 



16 



16 



16 



Total 



113 



180 



192 



Table 1. Content Units Available in Source Texts 



Procedures for Data Collection 

Report-writing took place over 3 consecutive (leys in the students' language 
arts/EngUsh classes. On the first day at the beginning of the 50-niinute class period, 
students wrote down ideas and information associated with the word rodeo. After 
these lists were collected for the priw knowledge measure, the students received their 
assignments, the thite so;irce texts, paper for their drafts, and "scratch" paper. At the 
time of the study, Texas was celebrating its Sesquicenteniiial, and numerous activities 
in the schools were focused on "Texana." The writing task, contextualized into these 
activities celebrating Texas events and traditions, ask^ students to write a report to 
infonn people about the rodeo. Tne audience was adults and teenagers in their 
community who were new to Texas and who did not know much about the nxJeo. In 
preparing the report, tlie students had the three encyclopedia articles from which to 
draw content, thou^ they were to put the information in their own woids. 

That first day, students woriced independently on the task throughout the 
remainder of the class period During tfie next 2 days in class, they continued writing 
their reports, using materials from the first day, and completed a final version by the 
end of class the third day. All products- scratch paper, planning pages, false starts, 
drafts, source texts-we:e collected for analysis, and records were kept of the amount 
of time spent each day and the total time that each student devoted to the report 



The major dependent variables included four measures for features of the final 
composition-quantity, organization, connectivity, and holistic quality-and three 
measures for task management-plan, rctranscription, and reading- writing time. 
Interrater reliabilities for quantity*, holistic qualiQr, and ccMinectivity were based on 
independent raters* scores for all 60 reports, two raters* scores for quantity and three 
raters* scores for holistic quality and c<»inectivity. Reliabilities for organization, 
plan, and retranscription were based oa subsets of 20 reports selected at random and 
scored by two independent raters who divided 15) scoring of the other 40 in the set. 
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Quantity. Quantity of content was the number of content units used by the 
student in the final version of the synthesis text. This number included units that 
were drawn from the sources and tha; were added, as determined by scoring the 
report against a composite template of units available in the thm source texts. 
Reliability for scoring was .95 (Pearson's ^. The template identified which units 
were available in one source, in two, or in all three (see Table 1). 

OrganizatiorL Organization was measured with a breadth/depth ratio of number 
of tiiematic chunks to number of content units included (Spivey, 1<)84). Ratio of 
breadth to deptii (cf. Collins & Centner, 1980; Nold & Davis, 1980; Vipond, 1980) 
is a way to quantijfy organization for descriptive texts, which tend not to have a 
canonical order for content in their collection structures. For this analysis of 
organization;, ccmtent units from the synthesis text were tagged for themes, including 
location (L), popularity (P), history (H), rodeo associations (A), sponsors (Q), 
events (E), skills (S), aU-giil rodeos (W), rodeo stock (M), otiier entertainment (O), 
and general information (G). For the analysis of organization, a vertical chain of 
thematic tags, as illustrated in Hgure la, was formed from tbe content units included 
in the synthesis. Aiid, as illustrated in Figure lb, when there was no overlapping 
content and when the writer did not supply a link, the content was considered to be 
two separate chunks; but, if the writer did supply a link, the two so connected were 
cmsidered to be one thematic chunk. For counting chunks in a text, interrater 
reliability was .84 (Pearson's t). The organization measure was number of thematic 
chunks divided by number of content units. 

Connectivity. Connectivity was also assessed witii a ratio, in tiiis case, number 
of perceived connective operations to number of content units included (Spivey, 
1984). Three raters read all the compositions and maited them for occurrences of 14 
different kirds of problems requiring connective inferences by the reader, such as 
searching for an antecectent, adding a referent, and resolving an ambiguity or 
contradiction. A reliability of .91 (Cronbach's a ) was cateulated for total problems 
counted per text. The measure used in analyses was the average number of problems 
in a text divided by the number of content units included in die text 

Holistic quality. The reports were judged for overall quality by three raters who 
read typed versions and gave each report a rating from 1 Oow) to 6 (high). The 
teachers who served as holistic raters did not perform any of the other, nx>re analytic 
ratings. The scoring system they used was a form of general impression marking that 
is commonly used in writing assignments (see Cooper, 1977), in which each rater 
gives one score for quality relative to the whole sample. The raters were trained in 
general impression scoring witii practice papers (written by students not included in 
the study) representing die range of quality for die sample. Thou^ die holistic ratr s 
were instructed to use die six-point scale, no predetermined set of criteria was given 
them. The holistic rating we used in the study was the summed general impression 
score, combining the tliree ratings, for which reliability was .89 (Cronbach's a). 

Plan. Planning, as evidence 1 in written plans and maiidngs, was measured 
with a four-level scale: 0, no writtm plan of any type and no marldng on the source 
material; 1, sketchy written pl?n, onderlining on the source texts, or both; 2, 
moderately elaborate written plan accompanied or not accompanied by underlining on 
the source texts; 3, elaborate written plan accompanied or not accompanied by 
underlining on the source texts. The measure, for which reliability was .97 
(Pearson's c), contrasts with die one used in Spivey (1984), which gave equal weight 
to maridngs on the scarce texts and to development of the written plan. 
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Figure 1. Thematic chaining (A) and thematic chunlcing (B) 
in a sample student text 



Retranscription. Instead of counting all changes made in the text, as Spivey 
(1984) did, we based the rrvision measure only on changes within and across drafts 
diat affectoi more than a single independent clause with all its dependent clauses and 
modifiers (a T-unit, Hunt* 1965). 'Diis decision was based on research suggesting 
no strong connections between writing quality and woird-level retranscriptions 
typically made by student writers (e.g.. Perl. 1979; Sommers, 1980; Spivey, 1984), 
The changes we counted, with an interrater reliability of .76 (Pbarson's i) for total 
counts per report, included additions of independent clauses as well as changes in 
OAkring and * i ovemll organization. The mr'^sure in the data analysis was the ratio 
of these changes tt> number of content units. 

Time. Time was the number of minutes students spent oa the task over the 
three-day period Since all shider^s were working on the task the first 2 days in 
class, the differences came on the tnird day, as they turned in their materials upon 
completing the task. 
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Results 

DifTerences in Use of Sources 

TTirec separate analyses of variance (ANOVAs) con^ared the students in their 
selections of content firom the textual sources. In these analyses as in other analyses 
in the study, square root tranrformations were used for data that were proportions. 
However, in Tables 2 and 5 and in Hgure 2 untransformed data are provided for ease 
of interpretation. The first ANOVA was designed to sec if students differed by grade 

ff"^ in selecting intertextually important content Intertextual inqxirtance was 
defined amply by repetition across the three texts: least important, 1, was infonnation 
unique to sin^e texts; medium important, 2, was infomiation present in two; and 
mostinq)ortant,3,wasinfbmuti(»inallthree. This analysis had two 
betAven-subjects fiunors, grade level and reading-ability groiq), and one 
^HMii n-subjects factor, importance of content; die dependent measure was the 
propcctkn included of die corient availabte for each importance level Tests of 
significance found main effiects for grade, E(2, 54) « 3.80, ft < .05, and for group, 
£G, 54) » 1 3.76, B < .0(H, but no si^ificant effect for die Interaction between grade 
and group, £(?. 54) « . 17. The older students included more content ftom die 
source duu die younger students did, and die better readers included more source 
content dian die less proficient neadera did. However, of major interest were results 
of die tests of significance invdving impoctance: a main effect for importance, 
£(2, 53) ■ 1 19.23, <0001, and interactions between grade level and importance, 
£(4, 106) ■ 2.85, n <05, and between reading ability group and inqxirtance, 
£(2, 53) ■ 3.49, fi <05. Aldiough bodi groups and all grades included larger 
proportions of intertextually inqxirtant content dian oi content appearing in only one 
source, die older students and better readers were niore likely to include die content 
diat was most important intertextually. Figure 2 illustrates diese linear patterns for 
grades and groups. The diree-way interaction was not significant, £(4, 106) = 1. 14. 

The odier two planned ANOVAs also compared die grade^^ and groups for dieir 
selections of cmtent fixnn textual sources. A comparison based oa die ratio of source 
content to total content included in die report resulted in a significant effect for reading 
abdity group, £(1, 54) « 7.85, o < .01, diough not for grade, £(2, 54) = .66. 
Whereas die less accomplished readers had larger proportions of "original" content, 
die accomplished readera had larger proportions of source content Table 2 shows a 
breakdown by group widiin grade far proportions of source content and suggests 
why the interaction between group and grade approached significance, £(2, 54) = 2.98, 
B < .06. ITie odicr test was intended to show if diere were dSferences in degree of 
reliance on a single textual source. The dependent measure in diis ANOVA was die 
largest proportion of unique information drawn firom a single source of all die unique 
source uiformation diat was included. This analysis reveafed no significant effects for 
grade, £(2, 54) » .28, or group, £(1, 54) = .02, or interaction between grade and 
group, £(2, 54) » 1.92, in degree of reliance on a single sou.ce. The source most used 
for unique content was die World Book, which contained less unique content dian The 
New Book of Knowledge but more dian Britannica Junior (see Table 1). 
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Grades 



Croups 6th 8th 10th All 



Accomplisbea .78 .86 .86 ,83 
Readers 

(.15) (.10) (.12) (.13) 

Less Accompli^ed .80 .62 .69 .70 
Readers 

(.11) (.26) (21) (.21) 



Table 2. Means and Standard Deviations for Ratios of Source Units to 
Total Content Units in Syntheses 



D^erences on Text and Task Measures 

Multivariate analyses of variance (MANOVAs) tested for overall differences 
among grades and between groups and for interactions between the two factors on 
text measures and task management measures. Following Stevens' (1986) 
suggestions, we used two MANOVAs, one for those n}easuits for which we had a 
strmg enqnrical and/cr theoretical basis and one for those measures that we were 
testing on a heuristic basis. The first MANOVA included measures for total quantity 
of content as well ax organization, connectivity, and holistic quality of the texts, and 
tfie second included die task managennent measures for reading-wnting time and for 
surface evidm of planning and revision. 

Table 3, i ir^ic^r laAon matrix, shows connelations among tiiese dependent 
measures. C »r f \ ^ apparent amcxig ail measures for the textual product, 
which inc?r x qua> '''^^anization, ccmnectivity, and holistic quality, and between 
the task mea: .u fr lan and reading-writing time. In addition, other conflations 
are among ^ ^^^^ a. .^asures from the text set and the task set: quantity with plan and 
time, orffudo,: on with plan, ccxinectivity with time, and holistic quality with plan 
and wid^ time. Wortii noting here is the lack of significant conelations between 
retranscription and any of the other measures. Students made very few large-scale 
changes in their reports, and there was littie variability in the ratio of textual changes 
to content units. 
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Text Measures 

1 Quantity 

2 Oisamzation^ 

3 Connectivity^ 

4 Holistic Quality 
Task Management Measures 

5 Plan 

6 Retranscription 

7 Hme 



.61*** -.43*** .79*** .36** 
•43*** -.65*** -.27* 
-.52*** -.16 
.39** 



.05 
-.07 
-.13 

.10 

-.12 



.45*** 
-.24 

-.32* 
Kyi** 

.36** 
.17 



Halt. N = (50. 

^Because smaller numbers for these measures reflect tighter organization and clearer connectivity, 
respectively, negative conelations with them suggest positive relations^ps wiili the constructs diev 
represent, except in the case of the intercorrelaticm between the two. 

*IK05 **b<.01 ***b<001 



Table 3. Intercorrelations among Discourse Synthesis Variables 



The first MANOVA with the text measures resulted in significant effects for both 
grade, E(8, 102) = 2.07, b < .05, and group, E(4, 51) = 8.92, b < .0001, tliough not 
for the interaction, E(8, 102) = .56. The follow-up univariate E-tests, summarized in 
Table 4, indicated differences among the three grade levels in quantity, connectivity, 
and holistic quality. Tests of least square differences revealed that the 6th graders 
differed finom the 10th graders in quantity and holistic quaUty and differed in 
connectivity from bodi the 8th and 10th graders, who did not differ si^icantly from 
each other. The older students' reports were naorc elaborate in content, were better 
connected, and were rated higher for holistic quality than the 6th graders'. The 
univariate tests for the reading-ability factor indicated significant differences between 
accon^lished and less accon^lished readers on all four measures: quantity, 
organization, connectivity, and hoUstic quality. The accomplished readers' reports 
were more elaborate, were more tightly organized, were better connected, and were 
rated higher for holistic quality than the less accomplished readers'. 
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On tfie MANOVA for the measures being tested on a heuristic basis, there was a 
main cffert for group, E(3, 52) « 6.40, b <001, but not for grade, E(6, 104) = .50, 
and there was not a significant effect for the interaction between group and grade, 
E(6, 104) = .56. Univariate E-tcsts following the significant overall effect for group, 
which are also reported ir< Table 4, indicated differences between the accomplished 
and less accomphshed readers on both plan and time. The better readers produced 
more elaborate written plans and spent nxne time on the task. Table 5 shows means 
and standard deviations for groups and grades on aU seven (tependent measures. 



E for Graded 



E for Group*' 



Text Measures 

Quantity 

Organization 

GHinectivity 

Holistic Quality 
Task Management Measures 

Plan 

Retranscription 
Time 



adf=2, 54 
*B<05 



bdf=l, 54 



3.59* 
2.09 
7.33** 
3.41* 

.06 
1.11 
.18 



14.38*** 
12.15*** 
6.94* 
36.87**** 

13.64*** 

.01 
11.20*** 



B<01 



B<.001 



**** 



BcOOOl 



Table 4. Univariate F-tests for Group and Grade Following MANOVA for Text 
Measures and MANOVA for Task Management Measures 
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Grades 



6di 8lh 10th AU 

AH A LA All A ~Ui AU A LA A LA 

Quantity 43.95 52.50 35.40 55.25 63.00 47.50 59.10 70.10 48.10 61.86 43.67 

(17.94) (19.92) (10.96) (20.02) (22.79) (13.91) (22.95) (20.44) (20.62) (21.63) (16.27) 

Oisanizationa .13 .11 .16 .10 .08 .12 .10 .08 .13 .09 .14 

(.06) (.05) (.06) (.07) (.04) (.08) (.06) (.05) (.06) (.05) (.06) 

Connectivityb 25 .25 .25 .16 .13 .18 .14 .10 .19 .16 .21 

(.17) (.23) (.08) (.07) (.05) (.09) (.07) (.04) (.06) (.15) (.08) 

Holistic Quality 9.20 12.00 6.40 11.55 14.20 8.90 11.65 14.10 9.20 13.43 8.17 

(4J3) (4.16) (2.91) (4.15) (170) (3.67) (4.04) (2.68) (3.74) (331) (3.57) 

P'an -75 1.40 .10 .80 1.20 .40 .85 1.10 .60 1.23 .37 

(1.07) (1.17) (32) (1.01) (1.13) (.70) (.93) (.88) (.97) (1.04) (.72) 

Rctranscripdon .02 .02 .02 .04 .04 .03 .03 .03 .03 .03 .03 

(.03) (.03) (.03) (.03) (.03) (.04) (.04) (.04) (.04) (.03) (.04) 

Time 95.25 101.80 89.70 94.15 101.30 87.00 97.45 107.60 8730 103.23 88.00 

(19.42) (19.48) (18.67) (14.39) (12.04) (1338) (22.22) (8.95) (27.08) (14.05) (19.82) 

ilflte. n - 20 fra- each grade, 10 for each group within each grade. A » accomplished readers, L = less accomplished 
readers. 

•This variable, thematic chunks/content units, is inversely related to the construct it is intended to 
represent A smaller number represents a nxm tightly organized text 

bTTus vaiiaWe, connective operationsA^ntent units, is inversely related to the construct it is intended to represent. 
A smaller number rqnesents a better connected texL 

Table 5. Means and Standard Deviations of Discourse Synthesis Variables 

for Grades and Groups 
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We also used ctiscriimnant analyses to see how well overall perfonnance on the synthesis 
task coincided with grade level and reading ability classification* Widi all seven variables in the 
analyses 58 per cent of the students were conecdy classified into their grades, but 83 per cent 
were conecdy classified into their original groups as accomplished or less accomplished readen. 
The measures did better for predicting reading ability classificadon than they did for predicting 
grade level classification. 

Discussion 

In this smdy of discourse synthesis, we examined students' performance on a 
report-writing ta^ that involved drawing content from source texts. Though we 
found readiag-ability differences as well as grade level d^ffierenoes in the overall 
quality of the reports, we were most interested in how students of differ&nt reading 
abilities £pom three grade levels might vary in using the sources and con^sing the 
reports. Develqnnental patterns emerged in smdents* selecting and connecting of 
content, whereas reading-abilit;* patterns were apparent in organizing as well as 
selecting and connecting of content Reading-ability differences were also reflected in 
extensiveness of written plans and in time spent on the task. 

DevelopmefiuH Patterns 

One strong finding in our study was a developmental difference in selecting 
consent finom the sources. Not cmly did the older students produce texts with more 
content, but diey were also more likely tc include die most inqHntant information, 
with important defined in die smdy in terms of repetition across texts. Though 
sttidents in all grades tended to include larger proportions of intertexmally important 
information (a levels effect)^ we found gains to b^ nost obvious between the 8th and 
10th grades, at about d^e same age as Brown and Day's (1983) findings for special 
gains in metacognitive development relative to summarizing. CXir lOdi graders 
appeared tc be more sensitive to intertextual in^Kirtance thw die younger students 
i^*ere, sir ce diey were more likely to include content diat was present in all three 
sources, \l1ien we asked them after they wrote how they deoded what to include, 
several mentioned using an intertextual criterion. For instance, one student said, 'If 
somedung is repeated in seveial aiticles, then it's obvious diat it's important" There 
is a possibility, though, diat some of die older smdents were better able to select what 
was inqxntant in the content domain without using intertextual cues. Tte content 
repeated across texts tended also to be key infomiation about die event structure of the 
rodeo. 

Another strong developmental finding in our study was the grade-level effect 
for increases in connectedness of discourse. The 6di graders' prose often had gaps, 
as the follov4ng excerpt from one report demonstrates. To form a coherent 
representation for this text, die reader has to expend great cognitive effort by filling in 
the gaps and by finding or generating referents for words: 

The cowboy diat is riding the bull or horse must hold the rope with one 
hand If they hold it widi two, diey will Imve some seconds taken off. 
Some cowgirls have die color and spirit of die Old Wnst Cowboys and 
cowgirls ride on their horses, and they sometimes rq)e up cows. But 
we aU know diat most of the people come for the cheering up. That is 
why diey use clowns. The clowns help die cowboys and cowgirls if 
diey fall off die bull or horse. Qowns sometimes get in die barrel to 
protect himself from die bull or horse 
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The developmental literatuic describes certain kinds of knowledge that people 
gain as they mature, knowledge that helps them provide ccmnections in their 
discourse* Important, of course, is students' ability to make explicit the connections 
that they see, to apply linguistic knowledge that includes the use of various kinds of 
referential and logical connectives. McCutchen (1986) interpreted developmental 
differences among her students as showing diat the older students "can use relational 
links anxxig concepts in the knowledge base to build coherence links in the discourse 
and . . . can control tiie linguistic constructions diat express those various conceptual 
and discourse relations" (p. 442). Another kind of knowledge that the older students 
may have been applying on this task is rfaeumod knowledge, an awareness of the 
needs of the audience. A number of studies have shown that, as people mature, they 
develop the abili^ to adapt a given text for a particular audience (e.g., Kroll, 1985). 
Some researchers explain diis abili^ to adapt to audience in terms of social cognition: 
a person's "intuitive or logical representation of others" (Shantz, 1975, p. 257), her 
characterization of others' mental states and cognitive processes. Socitd cognition 
includes recognizing that readers' representaticxis may be diffbrent from writers' and 
anticipating how language and stmcture may affect readers' understanding of the text 
(Rubin, 1984). 

Performance of Accomplished and Less Accomplished Readers 

From our results, it appears that general reading ability and success in 
synthesizing ovcAap to a great extent-reading ability and pnfonnance on this 
synthesis task resulting in the same classifications for 83 per cent of the cases in our 
study. On these gross classificaticm measures, reading ability was more closely 
related to synthesis perfonnance than grade level was. Certunly, while progressing 
through school stunts were de veloping some overall proficiency, as reflected in 
the holistic scor^, and they were J^^'V2l(q)ing some specific abilities in selectmg 
content and providing connectivity. Yet th^ were strong commcmalities among 
accon[q)lished readers across the grades and coamx)nalities among the less 
accomplished readers across the grades. What do better readers do in synthesizing 
that makes their textual products superior? What do ttey do that less proficient 
readers do not do? 

On this kind of task they apparently makt more use of the sources. Whereas 
students generally made strong use of the source material, averaging 75 per cent of 
the total content in their reports, the better readers selected larger prxqxntions of 
source material than die less skilled readers did, and included more source 
information across the three levels of intertextual importance. Reading ability, like 
grade level, interacted with importance. As in Spivey's (1984) study comparing 
groups of readers, as the information became more impc^ant intertextually, the 
accomplished readers were more likely than the less accraoplished readers to include 
it 

The two groups of readers also performed differendy in connecting and 
organizing the content they selected, as in Spivey's (1984) study. The better readers 
produced texts with more local cdierence, as evidenced in clearer connections for the 
reader, and also superior global cdierence, as evidenced in tighter text organization. 
The diffierences in organization are especially interesting. The accomplished readers 
were not only dealing with more content but also with larger chunks of content, since 
their texts (which received higher quality ratings) had nxwe integrated structures with 
noofe elaborated topics. TTiis ability to oiganize, or chunk, semantic content appears 
to be an important link between reading ability and writing ability. On the synthesis 
task, which involved firaming a new text instead of merely reproducing the structure 
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of a text they had read, the better readers displayed a sinxig ability to organize 
discourse (cf. Hiebert, Englert, & Brennan, 1983). TTieir integrated, well-developed 
structures contrasted with the less accomplished readers' strucnoes, which were 
broader and more sparse in content (cf. Vipond, 1980). 

Differences in the ability to organize discourse into chunks did not appear to be 
associated with grade level. Although the older students wrote papers with more 
c(»tent, the ratio of thematic chunks to content units remained relatively stable across 
the grades (averaging 5.5 chunks to 50 content units). A study conducted recently by 
Langer (1985, 1986) also examined reports written by students at different grade 
levels, though the report-writing task she studied was quite different from ours. The 
3ni-grade, 6di~grade, and 9th-{^Bde students in that study wrote reports that were 
"original" discourse (not drawn from source texts, as in our study) on self-selected 
topics (not all on the same topic, as in our study). Her report prompt was: "Think of 
something you know a lot about It can be soooething you studied in school, a 
hobby, or something you're just interested in. Write a report about that topic for 
someone your age to read" (Langer, 1985, p. 160). She had students write stories 
as well. When she tested for grade-level differences on measures of internal structure 
for writing in both genres, she too failed to find a significant effect (at b < .05) for 
grade-level. She dm, however, find an interaction between genre and grade level, 
with more change in the structure of reports than stories as ^ade level increas^ 
Though both her research and ours are developmental studies o^ report-writing that 
examme text organizatifm, inqxntant differences in these studfes make it difficult to 
relate or contrast our findings. Not only did the studies focus on different kinds of 
report-writing tasks, but we had a narrower grade span, 6tii to 10th in contrast to hers 
of3rdto9di. In addition, the measures for organization were quite different We 
used a single naeasure tiiat looked at breadth in relation to dq>th, whereas she used a 
combination of four measures for various as ects of stnicture: deepest node, broadest 
node, number of deeply linked nodes, and number of shallowly linked nodes. In our 
study, although students of contrasting reading abilities across the grades chunked 
content difGrrentiy, we did not find a developmental pattern. The younger students 
appeared to have i^t as much control of tfie overall structure (rf their reports as the 
older snidents did (cf. Durst, 1984). This finding is supported by research indicating 
tiiat many 6th graders are aware of text structures, includuig collection, and exhibit 
c(xnpetence with collectim structures in both conqnehension and production (Englert 
& Hiebert, 1984; Richgels, McGee, Lonuix, & Sheard, 1987). Figure 3 is a sketch 
drawn by one of our 6th graders, probably as a planning device, that suggests the 
clarity of his representation of the genre he was producing. 
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Figure 3. Sixth>grade studen<t's representation of report genre. 



Our findings suggest that differences between accomplished and less 
accoaq)lished readers may be due to effort expended on the task as well as to 
cognitive factors commonly associated with comprehension, such as sensitivity to 
structure. The better readers were maldrs more elaborate plans and were spending 
more time: they were i^arently setting a different kind of task for themselves, as did 
the better readers in Kennedy's (1985) smdy. This work and some previous research 
(e.g., WKta, 1983) lends suprport to Kennedy's contention that less skilled readers 
may be more passive in dieir interactions widi texts. This may help to explain the 
smaller proportions of source niaterial in their reports. For our synthesis task, dme 
devoted to the task and extent of the written plan were bodi related to the quality of 
the report In research on summarizing, Brown, Day, and Jones (1983) found 
planiung to be an inqx)rtant contributor to success in performing their task. 

Since our measure for planning was based on the written artifact, the smdy can 
only suggest but not really explore die dynamic process of planning~the process of 
generating and selecting content, structuring it, and setting goals that is often studied 
through think-atoud procedures (Flower & Hayes, 1981; Hayes & Flower, 1980). 
Nevrmheless, some of the operations of generatin^/selecting and structuring were 
apparent even in these written plans. Some evidences of selecting appeared on the 
source texts in students' markings of selected content and as notes on their planning 
pages. As illustrated in Hgures 4, 5, and 6, evidences of organizing appeared in their 
clustering, ordering, and uumbering on die planning pages. Fifteen of the smdents 
(1 out of 4) produced nooderatdy elaborate to quite elaborate written plans, 
preliminary structures often in gn^hical faroL 

Like our measure for planning, our measure for revision was based on the 
written artifact But unlike the scale for planning, our measure fw extensiveness of 
textual change was not statistically related to the quality of die text Nor was it related 
to other measmes for the product or die process. In an attenq)t to exclude low-level, 
"tidying-up" kinds of revisions, we based our measure only on large-scale changes in 
the texts. What we found was that students did not make many of these changes, 
such as adding anodier sentence m moving a chunk of content; diey averaged only 
1.5 per report Thus, our study helps to extend to syndiesis research die findings 
cited eariier diat secondary students do not seem to do much large-scale 
retranscripticm in dieir composing. We cannot diough, conclude diat students were 
not doing inuch revising, since diey may have b<sen making changes in die mental 
representation diat were not reflected in textual changes (cf. Flower, Hayes, Carey 
Schriver, & Stratman, 1986; Witte, 1985, 1987). 
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Figure 5. Clustering of content in a student's written plan 
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Figure 6. Numbering and ordering in a student's written plan 

23 OK. 



1) 



Condusior 

In conclusion, we would like to consider some of the panuneters of synthesis 
research, which is in its initial stages. Indeed, all sorts of questions about discourse 
synthesis are unanswered (e.g., specific cognitive abilities involved, performance of 
odwr groups of readers^ters, and role of topic and domain knowledge). Research 
designed to answer such questions roust also consider variability within synthesis 
tasks, which invdve peifonning die complex operations associated with reading 
(selecting, oiganiiing. ccmnecting) in a ifaetoiical act of discourse production. We 
must consider die factors of aim, structure, in^xntance principle, inifonnation source, 
and audience. 

In the study reported here and in two otiier studies (Spivey, 1984, 1988)» die 
assignment given die students cittd bodi an aim and a structure for the discourse. In 
this sftidy and in Spivey (1984), die students were asked to write to infoim, die task 
implying a collection structure with clusters of content and a relevance principle ba:>ed 
on intertextual importance, or repetition across texts. In Spivey (1988) die 
assignment again was to inform, but it clearly signaled an mqxjruuice principle based 
on relevance to similarities/differences. The ta^ constrained, or limited, what was 
considered relevant for inclusion (cf. I ^cKeown, 1985). In all duee studies, die 
participants, who were not encoura^ to present dieir own ideas, tended to rely on 
infonnation £tom die sources. And in all three, students wrote for a fairly mature 
audience diat was not particularly knowledgeable abcxit the topic. 

Efforts to explore other aims in synthesis, such as writing to present an original 
argument (Geisler, in press), produce different kinds of results in structure, 
importance princ^le, and source of information. Also, in situati(ms when die task is 
more ojwn, diat is, the constraints are not cued by the assignment, as in many 
academic tasks, ooe would expect to find more variability in processes and products 
(Ackerman, in preparation; Flower, 1987; Kennedy, 1985). Syntiiesis research, as 
well as other research into literacy activities, must attend to important task factors as 
well as cognitive factors. 
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